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The EPO does not accept any responsibility for the accuracy of data and information 
originating from other authorities than the EPO; in particular, the EPO does not 
guarantee that they are complete, up-to-date or fit for specific purposes. 

CF^OSS REFERENCE TO RELATED APPLIGATDNS 
[00011 

This application is based upon and claims ttie benefit of priority from the prior Japanese 
Patent Applications No. 2003-373924, filed Nov. 4, 2003; No. 2003-423661 , filed Dec. 19, 
2003, the entire contents of all of which are incoiporated herein by reference. 

BACKGROUND OF THE INVENTION 
[0002| 

1 . Field of the Invention 

[0003] 

Tlie present invention relates to an imgjge display apparatus, an image display method, and 

a record medium storing an smape display program. 

[0004] 

2. Description of the Related Art 
[0005] 

Recently, a swalow4ype capsuled endoscope has been developed in ttie field of an 
endoscope (for e)eniple. refer to the specifications of U.S. Patent Laid-open Application 
No. 2002/01 77779A1). This capsuled endoscope has tie image pickup function and the 

m#etess communications function. Afler a patient swallows it for observation (inspection), it 
sequentially captures tlie internal organs of the patient such as tlie storriach, the small 
intestine, etc., until it is naturally excreted from the body so that captured image inforniation 
(electronic data representing an image) can be sequentially transmitted by wireless.. 
[0006] 

Thi^, the image infbrmatJon transmitted by vsnreless is received by the receiver provided 
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oilside the body of the patient, stored in predetermined memory, and then used for 
diagnosis, etc. by a doctor by reading and displayifig the information on the display unit as 
necessary. 

SUMMARY OF THE INVENTDN 
[OOOTJ 

An aspect of tte present invention is an image display apparatus including a detection unit 
for detecting Image information hawng a predetennined characteristic; a generation unit for 
generating a scale converted image wWch is an enlarged image or a reduced image of an 

image a^lat€)d to the image information detected by the detection unit; and a display unit for 
displaying the scale converted image generated by the generation unit The display unit 
switches the display tbmiat of the scale converted Iniage and displays the image as 
necessary 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0008] 

FIC3. 1 shows tiie entire configuration of Uie capsuled endoscope system to which the image 
display apparatus accoitJing to an embodiment of the present invention is applied; 
[0009] 

FIG. 2 shov\« tie configuration of the system of the vwrkstotion; 

[001 0| 

FIG. 3 Is a flowchart of the displaying operation of the vwsrkstation accortiing to Uie 

embodiment 1 of the present invention; 

[0011] 

FIG. 4 shows an example of Hie display screen according to tlie listing display displayed on 

the display unit in S6; 

[0012]' 

FIG. 5 shows an example of the display screen according to the sequential display 
displayed on tiie display unit in 89; 

[001 3|" 

FIG. 6 shows another example of the display screen relating to Sie listing display of the 

present invention; and 

[0014] 

FIG, 7 is a flomchart of the displa^^ng operation of tlie workstation according to the 
embodiment 2 of the present invention. 

DESCRFTION OF THE PREFERRED EMBODIMENTS 
[0015] 

The embodiments of the present invention are e)^lained below by referring Id the attached 
drawings. 
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Embodiment 1 
[0016] 

FIG. 1 shov^ the entire coriguration of the capsuted endoscope system to which the image 
display apparatus according to an embodiment of the prBsent invention is applied- 
[00171 

A capsuled endoscope system 1 shown In FiG. 1 comprises a capsuled endoscope 2 and 
its package 3, a jacket 5 for a patient 4, a receiver 6 removable from the jacket 6, a 

worksMon 7 which is an image d^sp^ay apparatus acoordmg to the present embodiment a 
CF (CompactPtesh (registered trademark)) memory reader^iterS, a printers, a database 
10, a nefeM)rk 11. etc, 
[00181 

The capsuted endoscope 2 is pro\^ded with a capture unit and a wireless commynications 
unit not shown m FO, 1 . The image ir^)rmation (image information about a captured ^mage) 
captured by the capture unit can be e)d8rnayy transmitted by wireless by the wireless 
communications un^i 
[0019] 

The Jacket 5 Is provided with antennas 5a, 5b, So, and 5d for capturing the electric wave 
about the ^oiage information about the capturBd image tmnsmitted Irom the wiretess 
communications unit of the capsuted endoscope 2. The anlBonas are mounted for 
communications by cable or wireless with the receiver 6. 
[0020] 

The receiwr 6 is provided with an antenna 6a used m rece^vmg image information through 
electric waves directly from the jacket 5, a display unit 6b for displaying information required 
for observation (inspection), and an mput unit 6c for mputting information requirBd for 
observation (inspection). The receiver 6 can be provided with a remo\^b!8 CF memory 12 
stonng received image infomiation- 
[0021] 

The vrarkstatbn 7 comprises a body 7a, a display 7b, a ke\ifeoard 7c, a mouse 7d, etc., and 
has the processing fonction for performing diagnosis by a doctor etc, based on the image 
of the internal orxjans of a patient captured by the capsuled endoscope 2, The workstation 7 
comprises an interface connected to be able to communicate with each of the recei\^r6, 
the CP memory reader/Writer 8, and printer 9, and performs a read from and write to the CF 
memory 12, prints a patient chart, etc. The worlcstation 7 displays an image of the internal 
organs, etc, on the dispiay 7b according to the image information about the captured image 
in the body of a patient transferred from the receiver 6. Furi:hermore, the workstation 7 has 
the communications function for connection to the network 1 1 , and stores an obser\?^tion 
result, etc. of a patient in the database 10. The database 10 can be inciuded in the 
workstation 7 instead of being obtained over the network 1 1 . 
[0022] 

As shown in FiG. 1 , before starting an inspection, the capsuied endoscope 2 is taken from 
the package 3. When the capsufed endoscope 2 is swaiiowed by a patient, it passes 
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through the gorge, proceeds in the coelom by the peristalsis of the alimentary canal, and 
sequeniaiy captures images of the coelom. Then, as necessary or at any time, the electric 
waves of tlie image Information about a captured image are ou^JutlTDm tie c^apsuled 
endoscope 2 as a result of 8ie capture, and the respecSve electric wa^^s at tie antennas 

v5a, 5b, 5c, and 5d of tiie jacket 5 are captured. Then, a signal from an antenna 5 liavlng a 
received elecfric wave of high intercity is tansmitled to the receiver 6 outside the body of 
the patient 
|0023| 



In the receiver 6, the image infomiation about captured images to be sequentially received 

is stored in the CF" memory 12. The receiver 6 is not synchronous with the start of the 
capture of the capsuled endoscope 2, but the start and the end of reception is controlled by 
the operation of tiie input unit 6c. The Image information about a captured image can be tiie 
irr^age infomiation about still images captured as a plurality of frames/second for display as 
dynamic images, or the image information about a nonnal dynamic image, in tfiis example, 
the image Infonnation about a still Image in the preserrt embodiment is used. 
[0024] ' 

When tie observation (inspection) of tlie patient 4 using the capsuled endoscope 2 is 
completed, the image infomnation about the captured Image stored in the CF memory 12 Is 
Iransfemed to the workstation 7 through the cable, or the CF memory 12 storing the image 

infonmation about tlie captured image is attached to the Ci- memory readerMTiter 8, ariJ the 
irr^age hifbnnation about tiie captured image can be transfenBd to the workstation 7 through 
the CF memory reader/writer 8. 
|0025| 

in ^e workstetlon 7, tte tansfemed image information about tte captured Image is stored 
for each patient, tiie image inftjnnation about the captured image of a specific patient is 
read as r¥3cessary, arid displayed on tiie display 7b. Thus, useful data for piiysioiogical 
study can be obtained and various lesions can be diagnosed for all all meniary canals of a 
human body to tiie depth (small intestine, etc.) tliat cannot be reached by an ultrasonic 

[0026] 

Smce the capsuted endoscope 2 travels with the penstalsb of the alimentary cana^ as 
descnbed above, it captures an ^mage at a predetermined capture rate (for exampte, 2 fps) 
wh^e repeatmg traveling and stopping with the peristalsis. Therefore, although the tota^ 
number of the captured images related to the image information §s enormously large, there 
are a number of Images indicating almost no color change in Hie images continuous in a 
time series. 
[0027] 

In the workstation 7, when a larqe number of imaqes containinQ the abo^^mentioned 
images continuous in a time series and indicating almost no color change are to be 
dispiayed, there is an appropriate display method for easily grasping tie large number of 
images and easily retrieving from among tiie large number of images a desired image, for 
example, an Image of an alfectional portion. 
100281 
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The conHguratbn and the operation of the workstation 7 are e^lained below further in 
[0029] 

FIG. 2 shows tie cx)nfigyFaUon of the system of the workstation 1. 
[0030] 

Tlie vvorkstatkMi 7 comprises a CPU 13, FiOM 14, FiAM 15, memory 16, an W 17, a display 
unit 1 8, an output unit 1 9, an input unit 20, etc. Each of them is corviected via a bus 21 so 
tiat data can be trarBmitted and received as necessary. 
[0031] 

Tlie CPU 13 controls the operation of the entire workstation 7 by reading the control 
program (loduding Hie image display program) stored In advance in the ROiV1 14. The ROM 

14 stores necessary data for various processes in addition to tfie control program. The RAM 

1 5 Ls used for temporary storage of image information input throi^h ftie l/F 1 7 or Image 
InforTTiation for use during various image processing, or as a work area, etc. for execiilon of 
a control process by the CF^U 13. The memory 16 Is a large-capacity memory storing image 
inlbrmation input through tie i/F 17, and can be, for ejQoiples a hard disk, etc. The l/F 17 is 
an interface for allowing ttie receiwr 6 and tte CF memory reader/writer 8 to communicate 
data. The display unit 18 corresponds to the above-mentioned display 7b, and displays 
images, etc. relating to the image information. The output unit 19 performs various outputting 
processes with the printer 9 or with tlie database 1 0, etc. over the network 1 1 . Tlie input 20 
corresponds to the above-mentioned keyboard 7c, the mouse 7d, etc., and inputs various 
data dependirig on the instructing ope»f'ation of .a doctor, etc. 

[0032] 

The displaylr^ operation of the m«ri<station 7 is ejqslalned below Tlie displaying operation is 
one of the operations performed by the CPU 13 reading a con^oi program stored in the 

ROy 14. 
[00331 

FIG. 3 is a flowchart of the dispia^^ng operation of the workstation 7. 
[0034] 

In tJiis operation, the image information about the captured image of a specific patient is 

read from the rnernory 16 (step (hereinafter referred to simply as "S") 1). 

[0035] 

When the operation of this flowchart is started, the image information captured by the 
capsuled endoscope 2 is assumed to be stored in the memory 16 as explained above by 

refenirig to FIG. 1 . 
[0036] 

Then, the image information about the image indicating the same or sitostantially the same 

cobr is detected as Uie image information having a predetermined characteristic from the 

image intbrniation read in SI (S2). Ttie information is detected by, for example, obtaining 
color inforniatlon or a brightness value from image inf?3rmation, and detecting the iriiage 
intbrniation containing substantially the same information as the obtained color Irformation 
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in the same or a predetermined range as the image inforniation about the image Indicating 
iie same orsubstantiailythe same color. To be more practical, an average vakja (or any 
other stetistical ya\m can be used) of color information is obtained from image information, 
and the image ir^ormaiJon containing the obfelned average value of the color infonnation in 

Hie same or a predetermined range is detected as the image information about an image 
indicating the same or substantially the same color. The image Information when color 
inforTTiation is obtained can be the image information about one image or the image 
intbnTiatJon about one or more predetermined areas of one image. 
[0037] 

Then, in the image information detected in S.2 about an image indicating the same or 
substantiaiiythe same color, each piece of irrage Information is selected fer each image 
irrfbmiation group having continuous frame numbers, that is, for each image information 
group of contJnuous information in a time series (S3), In this embodiment, it is assumed that 
a piece of image information havir^ the smallest frame number in the image information 
belonging to the irYiage Information group Is selected, but it Is also possible to select the 
image infonnation having the largest frame number. A frarrie number is assigned to the 
image information In a time series based on the capture date and time, etc. in the present 
embodiment, tiie older the capture date and yme, tiie smaller the frarne number. That is, tlie 
latest capture date and time has the largest fl^me number. 
[0038] 

Hien, based on the Instructing operation of a user such as a doctor; etc, using the ke}^)oard 
7c or the mouse 7d, It is determined which Is indicated by tlie display switch instruction, 
lis^ng display or sequential display (S4). 
[0039] 

if tiie determination result In S4 is a display switch instixiction fer listing display, then the 
scale conversion is performed for the ilstlrig display on each of the images related to the 
image Inforniation selected in S3, a scale converted Image (which can be thumbnail 
images) is generated (S5), .And the scale converted image is displayed in a listing display 
format on the display 7b (S6), Thus, only an Image Indicating a cotor change is displa>^d in 
a listing display format 
[0040] 

On the other hand, if the determination result In S4 is a display switch instruction for 
sequential display, tiie set number of displayed images is changed into the number of 
displayed Images indicated by li^ switch instruction (S7). .Accordir^ to present 
embodiment, the number of displayed Images which can be indicated by a switch Insfruction 
is assumed to be 1 , 2, or 4. Hie switch instruclion of llie number of displayed Images can 
change tie image si2B of tie scale conwrted image generated In SB described later. 
[00411 

Then, a scale conwrted image which can be an enlarged image or a reduced image is 
generated depending on the set number of displayed images (S8), and tiie scale converted 

image is displayed in a sequential display format on the display 7b (S9). Thus, only an 
Image indicating a color change is displayed in a sequential display fonmat 

100421 
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After SC5 or S9, it is determined by the instructing operation of a user such as a doctor, etc. 
usLng the keyboard 7c or the mouse 7d whether or not an execution comptete instruction ftsr 
tie application relating to the present operation l^s been issi^d (S10). tie determination 
result is YES, Hie ptBseri operation terminates. If NO, cortel is returned to S4, and ttie 
abo\«~r^ientioned processes are repeated, 
[0043] 

FIGI 4 shows an example of a dispiav screen of listing dispk^v displayed on the display 7b in 

S6. 

[0044] 

In FIG, 4, a listing button 22 for a display switch instruction for listing display, and a one- 
button 23a, a two«buiton .23b, and a four-button 23c for a switch instruction for the number of 
displayed images for the sequential display in a sequential button area 23 for a display 
svwtch instmction for sequential display are provided at tfie upper portion on the display 
screen, in S4 above, the listing button 22 or any of the buttons 23a, 23b, and 23c on in the 
sequential button area 23 is pressed by the instructing operation using the ke>4)oard 7c or 
tie mouse 7d, tliereby issuing the display switch instruction. By any of the one-button 23a, 
f\& tvTO-button 23b, and the four-button 23c pressed by the Instructing operation using the 
keyboard 7c or the mouse 7d, a svwtch instruction of tte number of displayed images is 
issued. 
[0045] 

ESelowthe listing button 22, a patient ID, a patient name, sex, and his or her birthday are 
displa^d as the Information about the patient m4iose Image is to be displayed, 
[0046] 

An image display column 24 is provided at tiie center of the display In the image 

display column 24, the six scale converted images (which can be thumbnail images) 
generated in S6 above are displayed in a time series. In tlie six scale converted images, 
frame numbers are assigned to the iniages in an ascending order from left to right That is, 
the rightmost image arranged is assigned tiie largest frame number h ttiis embodiment, 
scale converted images 25, 26, 27, 28, 29, and 30 are displayed in the ascending order of 
tie fi^me numbers. The frastie numbers of ttie scale osnverted images are ttie same as the 
image information of tie generation source. 
[00471 

On the display screen, although there are seven or more scale converted images penerated 
in S5 above, the remaining scale converted images can be displayed on the image display 

column 24 by moving a slider 31 left or nght in the instructing operation using the keyboard 
7c or the mouse 7d, For exanipie, by tlie slider 31 moving to the left by the move instruction, 
a scale converted image iiavlng a smaller frame number than the scale converted image 25 
can be displayed. Similarly, by the slider 31 moving to the nght by the move instruction, a 
scale converted image having a larger feme number Itian tie sraile converted image 30 
can be displayed. 
[0048] 

Below the Image display column 24, a higi>speed inver>5e regeneration button 32 for high- 
speed regeneration in the inverse direction (In the direction toward a smaller frame rMnber), 
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an inverse regeneratbn button 33 for normal regeneration in the inverse direction, an 
inverse frame button 34 for frame regeneration in the mverse direction, a temporary stop 
button 35 for temporary stop of regeneration, a frame button 36 for frame regeneration in the 
forward direction (in the direction toward a larger frame number), a regeneration button 37 

fer nomia! regeneration in the forward direction, and a high-speed regeneration button 38 
for high-speed rBgeneration m the forward directbn are provided as the buttons for 
regeneration of an ^mage fo be displayed in the image display column 24„ 

For example, on the display screen for tis^ng display, wt^n the inverse frame button 34 or 

the frame button 36 "is pressed, the scale converted image listed in the image display 
coiuriin 24 is shifted by one. if the inverse regeneration button 33 or tiie regeneration button 
37 is prBssed, every image or every sixth image of the displayed scale converted irriages Is 
changed and regenerated every first or sixth image, ^ tlie high-speed Inverse regeneration 
button 32 or the high-speed regeneration button 38 is pressed, every sixth image of the 
displayed scale converted images is changed and regenerated at a high speed. 
[0050] 

A close button 39 is provided to tlie right diagonally below the display screen, and by 

pressing the dose button 39, this displav screen is closed. 

[0051] 

FIG. 6 shows an example of the display screen for sequential display displayed on the 
display 7b in S9, However, the display screen in FIG. 5 IrKlicates tli8 display screen 
displa^d %vheri the two-button 23b is pressed, 
[0052] 

As shov\ffi in FIG. 5, vsdien tie tw-button 23b Is pressed, i\vo scale converted images which 
can be an enlarged image or a reduced image generated In Sj8 is displayed In a tim^e 
series in the image display column 24, and the t\¥0 scale converted images are displayed 
m^i an image having a smaller frame number on tlie left. In this example, scale converted 
images 40 and 41 are dispiaved. 
[0053] 

On this display screen, although there are three or more scale cxsnverted images generated 
in S8 above, the remaining scale converted images not being displayed in tiie Image 
display column 24 can be displayed by pressing the hlgi>speed irwer'se regeneration button 
32, the Inv^rBe regeneration biton 33, the inverse frame button 34, llie temporBry stop 
button 36, the frame button 36, the regenefBtion button 37, and the high-speed regeneration 
button 38. For example, by pressirg the inverse frame button 34 or the frarr^e button 36, the 
scale converted Images not being displayed in the Image display column 24 can be shilted 
and displayed one by one. If the inverse regeneration button 33 or the regeneration button 
37 IS pressed, the scale converted images not being displayed can be regenerated In two 
units, and y^n the temporary stop button 36 is pressed as necessary, ttie update of display 
can be stopped with two desired scale converted images displayed. When tiie high-speed 
inverse regenenation button 32 or tie high-speed regeneration button 38 Is pressed, the two 
scale converted images not being displayed can be regenerated in tvye units at a high 
speed. When the temporary stop button 35 is pressed as necessary, two desired scale 
converted images can be displayed. 
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10054] 

On the display screen for sequential display, an image group switch button 23d is newly 
provided. By pressing tihe image group switch button 23d, a target to be displayed in the 

image disptey column 24 can be switched to a spedliG scate converted image group of an 
image irfcrmation group having continuous frame numbers end md^cating the same or 
substant^a^y the same color For e)empte, when one scate con^^rted image displayed m the 
^rnage disptey column 24 is mdicated in the instructing operation by the mstructing operation 
of a user such as a doctor, etc, using the keyboard 7c or the mouse 7d, and the image 
group switch button 23d is pressed, thereby displaying in the image display column 24 and 
conf^rmmg the scate converted image group of the image information group to which the 
image information that is the source of the indicated scaie converted image betongs. 
However the scate converted image displayed at this time is generated by the scate 
conwrsion as in the process in S8 above. 
[0055] 

FO. 5 shows the dispfey screen for sequential display dispfayed when the two-button 23b is 
pressed. However, when the one-button 23a is pressed, one scate conwrted image 
generated by the scate converBion when the number of d§spia>ed images is 1 is displayed. 
When Hie four-button 23c is pressed, four scale converted images generated by the scale 
conversion when the number of displa>^d images is 4 are displace! in a time series. For 
exampSe, vyfien the number of displayed images 1 , then one scate converted image wNch 
is an enlarged image dispte^d. When the number of dispiayed images is 4, four scate 
converted images which are reduced images are displayed, in this case, as described 
above, by pressing the high-speed inverse regeneration button 32, the inverse regeneration 
button 33, tie inverBe frame button 34, the temporary stop button 35, the frame button 36, 
the regeneration button 37, and the high-speed regeneration button 38, the remaining scate 
converted images not being displa^d can be displayed, 
[0056] 

As described above, according to the present embodiment, one scate converted image can 
be generated and displayed for each image inibrmation group for images indicating the 
same or substantially the same color and having continuous frame numbers, thereby 
dispiaying only an image indicating a cobr change. Therefore, a user such as a doctor, etc, 
only has to confirm the image mdicating a dispia\^d color change to easily grasp the 
images related to a terge amount of image information. Furthermore, when a desired 
image, for example, an image including a captured affectional portion can be easily found 
based on the image indicating a color change, 
[0067] 

Add^tionaly, the dispiayformatof the scale converted images can be switched between 
feting dispiay and sequentiai display, and the number of displa^^^d images can be changed 
in the sequential display. TherBfbre, a user such as a doclDr etc, can confirm an image 
indicating a color change in a desired display format 
[0058] 

Furthermore, smce scate converted images can be displayed for each image information 
group of images having continuous frame numbers and indicating the same or substantiayy 
the same coter, it is not necessary to confirm many times the same portion of an image 
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captured at drfferent angles. 

li the present embodiment expiamed above by referiing to FIG, 5, a target to be 
disp^a\^d in the sequent^a^ disptey fermat can be swfched to a spedfic scate converted 
image group of an kiiage kiforrnation group havmg contmuous frame numbers and 
indicating the same or substant§aly the same cobr For example, similarly m the ^stmg 
display fermat a ta^et to be listed can also be switched to a spedfio scale converted 
BTiacje 9 roup of an imag8 information group having continuous frame numbers and 
indicating the same or substantially the same color. 
[0060] 

In the present embodiment the disple^ng operation explained by referring Id FIG. 3, a 
scate converted image of an image related Id the image mfbrmation setected m S3 
generated In S5, and the scale converted image is displayed in the listing display format in 
S6. Howe\^er, for exampte, in S5, a scale converted image can be generated by the scaie 
conversion for listing dispfeyfbral image inlbrmation about the images indicating the same 
or substantiayythe same cotor detected in S2, and in S6, a scaie converted image group 
generated from the image information group aboiit the imayes having continuous frame 
numbers and mdicating the same or substantially the same color can be defined as one 
group and dispia^d in a listing display format 
[0061] 

FO. 6 shows an exampte of a display screen for listing display m the abo\^-mentioned 

CBse. 

[0062] 

As show] hi FIG. 6, a ^scale cx)nv8rted image group generated from an image information 

group related to the images having continuous frame numbers and indicating the same or 
substantially the same color can be indicated by doited lines as one group and displayed in 
the IsUng display format in tiie image display column 24. In the example si'iown in FIG, 6, a 
scale cofTi^rted image group comprising scale converted images 42a and 42b is indicated 
as one group, a scale converted image group comprising scale converted images 43a, 
43b, and 43c Is indicated as one group, a scale converted image group comprising a scale 
converted Image 44d, etc. is indicated as one group, and the groups are displayed in the 
lasting display format. The scale converted images 423, 43a, and 44a are tie same as the 
scale converted images 26, 27, and 28 shown in F"IG. 4. 
[0063] 

In tlie display screen shown In FIG. 6, the remaining scale converted images not being 
displayed can be displayed by moving the slider 31 by a move instruction. Furthermore, by 
pressing the high-speed inverse regeneration button 32, the inverse rBgeneration butbn 33, 
Hie mver"se frame button 34, tlie temporary stop button 35, the frame bution 36, the 
regeneration button 37, and tiie high speed regenera^on button 38, tie coircsponding scale 
conwrted images can be fegenerated. 

EHmbocllment 2 
[0064] 
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The presert embodiment different from the embodiment 1 in a dispteymg operation of the 
workstayon 7. That is, in the present embodiment the workstation 7 detects image 
information having predetermined color infomiation as image information having a 
predetemiined characteristic from a large amount of image mformation captured by^e 
capsded endoscope 2, Hereafter as m the embodiment 1 , ^mage inforrr^ation is sefected 
for each image mformation group having continuous frame numbers in the detected image 
information, and the selected image information is displa^d in the display format 
depending on the display switch instruction. 
|0066| 

FIG. 7 is a flowchart of the dispiaying operation of the workstayon 7, As in the embodiment 
1 , the present operation is also performed by reading a control program stored in the ROM 
14 m advance bv the CPU 13 and e>sBcuting the program. 
[00661 

In FIG, 7, first hi S1 1 , as in S1 (refer to FIG, 3) above, the image information about the 
captured image of a specific patient is read Irom the memory 16, When the operation 
according to the present flowchart is started, as in the embodiment 1 , a large amount of 
§mage information captured by the capsuled endoscope 2 is sfored m the memory 16 by 
patient. 
[0067] 

Then, in ^mage information having predetermined coior information is detected from 
the image information read in the previous step. In this embodiment with a view to 
displaying only an image indicating a bioodshedding portion, coior information with which ^t 
can be determined that Image information is related to an image captured as a 
bbodshedding portion is predetermined, and the image information irxJicating the color 
^nfbrmation is detected, in this case, the image information can be detected by statistically 
obtaining in advance en average value of pixel values of the entire image with which it can 
be determined that the captured image indicates a bioodshedding portion, and by detecting 
the infc)rmation containing an average value of pixel values of the entire image related to the 
image information to be detected, or the information containing an average value of pixel 
values In one or more predetenryiined areas of the image related to the image information to 
be detected in a predetermined range having the awrage value as a central ^^^^e or in a 
predetermined range including the average value as tie image mformation related Id the 
captured image indicating a bioodshedding portion. 
[00681 

Then, in S1 3, in the image information detected in the previous step, each piece of image 

^nfc)rmation is selected for each image information group having continuous frame numberB. 
In this embodiment a piece of image information selected from an image information group 
is defined as the image information having the smaliest frame number as in the previous S3 
(refer to FIG. 3). However, the information can a^so be defined as having the largest frame 
number. 
[0069] 

The processes in SM4 through S20 are the same as the processes in the previous S4 

through S10 (refer to FIG, 3), 

[00701 
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That is, in S14, wlien a user such as a doctor, etc, issues a display switch instruction for 
lis^ng display, control Is passed to S15. Hie scale conversion Is performed for listing display 
of each image related to tiie image information selected in S13 to generate a scale 

converted image, and tie scale converted Image is dlsplapd in tie listing display format on 

the display 7b (31 6). 

[0071] 

Otherwse, in S14, when a display switch instruction for sequential display is issued, control 
is passed to S17, and the number of displayed images is changed into the number based 

on the display switch instruction. In the present embodirnent, the ir?isge size of the 
generated scale converted image depends on the set number of displayed images. For 
each of the images related to the image) inforrTiation seleoted in S13, the scale conversion is 
perfeoTied based on the number of displayed Images set in S17, thereby generating a scale 
converted Image which is an enlarged image or a reduced image (S18), and the scale 
conwrted images depending on the number of displayed images are displayed in the 
sequential display fonnat on tt^ display 7b (S1 9). 
[00721 

After S1 6 orS19, at an inslruction of a doctor, etc., it is detenmined vt^tiieror not the 
execution complete instruction of an application according to the present operation has 

been issued (S20). i the detemiination result is YES, the present operation tennir^tes. If the 
determination result is NO, tiien control is returned to S14, and tie above-mentioned 

process is repeated. 
|0073| 

In the present operation, inS16, for example, scale converted images are listed as in tie 

listing display shown in F1(3. 4 above, and in S19, tiie scale converted images are 

sequenially displayed as in t« sequential display shown in FiG. 5. 

[0074] 

As described abow, according to tiie present embodiment only an image related to tie 
image infomiation detected from among a large amount of image information captured by 

the capsuled endoscope as the image information ahout tiie image captures as a 
bloodshedding portion can be displayed. Therefcjre, a doctor, etc. can easily confirm the 
image captured as a bloodshedding portion without confirming the image about all image 
infomiation. Furthermore, since the dispfey format can be switclied to listing display or 
sequential display, a doctor, etc. can switch into a desired and recognizable display format 
as necessary. The image displayed at tills time is an image related to the image infomiation 
selected piece by piece for each image Information group havlrg continuous frame 
numbers. Therefore, a doctor, etc, can be free of confirming many times tiie images of the 
same portion talcen at diflBrent ar^gles, tereby efficient confirming an image taken as a 
bloodshedding portion. 
[0075] 

In tlie displa^^ng operation shown in FIG, 7 according to tJie present embodiment, for 
example, in the sequential display performed in SMS, as e:i«piained above by referring to FIG, 
6, a target to be displayed can be switched to a specific scale converted image group 
relalir^ to an image infomiation group having continuous frame numbers in the image 
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hiforrriation detected as the image information reiated to the image captured as a 
blocxisiiedding portion. Similarly, in the iisting display, a target to be dispiaysd oan be 
switched to a specific scale con^rted image group relating to an Image information group 
having continuous frame numbers In the image information detected as the Image 
Infomiation related to tie image caplured as a bioodsheddtr^ pordon. 
|0076| 

Furtheniiore., in the displaying operation shown in FIG. 7 according to the present 
embodiment, for example, In S15, a scale converted image Is generated by performing the 
scale conversion for listing display on tfie image related to ail image information detected in 

S12. in subsequent S16, a scale converted image group generated from the image 
inforTTiatlon group having continuous frame numbers is indicated as one group so tliatthe 
scale converted irriages can be listed. In this case, for ej^smpie, as in the iisting display 
shovwi in FIG, 6 as described above, the scale converted image group is enclosed by the 
dotted lines for each scale converted Image group having continuous frame numbers. 
[0077] 

Additionally, in the displa>^ng operation shown in FIG. 7 according to the present 
embodiment, in S12j the image information having color information which can be 
detemiined as tfie Image information related to tiie image captured as a bioodshedding 
portion can be detected as the Image infomiation having predetermined color information, 
but the image information having another cotor information can be detected fortiie image to 
be displayed. 
[0078] 

In the workstetion 7 accordiriq to tiie above-mentioned embodiment 1 and 2, tiie control 
program for controlling the above-mentioned displaying operation is stored in the ROM 14, 

bit the control program can be stored in a portable record medium such as CD-ROfvl, a 
DVD, a lloppy (registered tradeoiaric) disk, etc. or a storage device of a program provider, 
and can be read by the woricstation 7, For example, when the control program is stored in a 
portable record mediyrn, the portable .record .medium can be inserted into the dnve device 
not shown In Itie attached drawings and ttie controi program can be read, arnj the read 
control program can be e)®cuted after being stored in the storage unit of the RAM 15, tie 
memory 16, etc. Otherwise, when ttie control program is provided by a program provider 
through a communications circuit (network 1 1 , etc.), the control program stored in tiie 
storage device or memory, etc. of the program provider is received by the workstation 7 
tirough §ie coniniunications circuit, and the received program is stored in the storage unit of 
Uhe RAM 15, the memcry 1 6, etc. and e)®cuted. Otiienflflse, tiie contiiDl program can be 
stored In the memory 1 6 In advance, and then executed. The conliol program stored in the 
record medium, etc. can reaii2B a part of the above-mentioned displaying operation. 
[0079] 

As the Image information having a predetenriined cheractenstic, the Image intbrmation 
related to the Images Indicating tiie same or substantially ttie same color is detected in tiie 
embodiment 1 , and the image irribrmation having predetemnlned color infonmation is 
detected in the embodiment 2, ft Is also possible to detect tiie image Information having 
another charactedstlc as necessary. 
[0080] 
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h the embodiments 1 and 2, the image mformation processed by the workstatbn 7 is 
obtained m a time series by the capsuled endoscope 2. Hovvever, the image information 
can be obteined in a time series by another medical device, or the image information 
obtabied in another time series can be used, 
[00811 

Furthermore, mthe embodiments 1 and 2, the number of dispteyed images simdtaneously 
^^stad ^s not ymited to 6, or the number of dispfeyed images sequentially displayed is not 
Simited to 1 , 2j or 4, 
[0082] 

The present invention is described abo^ m detail, but it is not limited to the above- 
mentioned embodiments, and it is obvious that the present invention can be n^ayzed as 
various improvements and variations within the scope of the qist of the present invention, 
[0083] 

Acconjmg to the present invention, a large amount of image inlbrmation can be easily 
grasped, and desired image inlbrma^on can be easily detected from a iarge amount of 
§mage information. 
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^^3^^o#x.^^>nT^*$nl.« Sfc. j£S^;f>iS'y3 3xj«^;j^'^>'3 7 75^wr§ti. 

. ©5S3tH^fe>1^'^'>-3 2X{SiS3aS^fe4^'^>'3 8*^'ffT$ix-g.i:. mY=.^iVC\'^h:^'r~ 

)V'smmmi^b^%^z-mmz-^'^^fvz.M^^fvh . 

[0045] 

ia5{±, s 9t-tv X7°p-f 7 b \,z^^.^fttzm<!Km^^z\^hm^mm<D-^\^w-\^fz 

mxtih, fML. lamto^TOi. 2*S:^r:5'>'2 3b*^ffT§ix/;t#tc«^S^x/i« 

[0046] 

Rllltc^LT'cj; iiiffi^ffl2 4tc{i. 2fe^":^'y 2 3 bcoffTtcjSt-C . ftrii^o 

s 8 •cf^)^s:fi>tfii:AB«^ t < \m>\<m^h t£hx'r-)vmmmm^mz 2 -^^^ 

$tt. ^co2'^cr)xir~/i'^mmmzi5\,^xi,±^ &M(omim^yu-j^mncr)4-,^\,mB 

[0047] 

Tt. ft5$j*Hrt4^'^>3 2 . jSB^^^'^'yS 3, iSr7V4^'^>'3 4 . — ff^^'^VSB, 

nv^^'^-yse. m^^^^ysi , mWM^^^^y3Qcr)Wf(-zi.-yX. ffif«S^lM2 4 
« Mi«f. jl3v;ii'^y34X{i3-74^~^'>'3 6(7)jfT(cJ;'>T. iiima*ff€2 4(c*^ 
^;i<'^>-3 3X{iB±4^'^>3 7<50ffTtcJ;-T>t:. ^§#i.-Ci.^^V^X^-;L'^jlli«Sr 
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Tie j; 0 F/fSc=0 2 ocT);^ :>--;tMH« Sra^$ it d i: j^r^T- # , 
[0048] 

d <7)mmmm^^9 >- 2 s d cr)ffT(':ij; "9 , m\f.m.^m 2 4 t:r^5Ft--g>«#<^ . n'^co , 

7 d cr>mmmnz X -^Tfi^Sn/^a. HfftPW#;l<"^' y 2 3 d 7&iffT§fL^ .r t J: 0 

^^ix-g-x^-zl'^B^ti. ta^c7)S8£7)i5og(7)j:-3t. x^-zt^tci-oT-f^^S 
[0049] 

m3\,z\i. 2mTf^d'y23htm-r^n.tzh%<^m'K^izi%h^mm^^hfz 

1^^^9y2 3 a/j^-ffTSfLZ-^t^tCfi:. aff<a^K»::6n T-?)^ .1 1 t^jEt/iX^r- 
'mm%.imWUzA-:>^^fx.h l. a t^S „ Mi.{f . Wmi'^ifi 1 f feS^^tJi 
^if'.9y32, ^M^if^9y33 , i£3V#^>'34. ^;J^'^'>-3 5, nvijf^yse 
[0050] 

tLfz-&m^^tcohmmco^^ms^'thf3irx\ mkcomimmi,zimmi&i^^izmm 
i . m^^titi^m^^tcr>$>&mmimz^^t,zmLiii-rzbifiT^ h , 

[0051] 

fi. FJtMco^^^fMt^i 'o^mmmh^^mw.^mmth^zhii^x^h. 
tfz. y u-^m^:i}mm-t^ m-ximm-co-&^^^^mmzi^:i>mimmmmi,z 

[0052] 

i^, ^mmmx-i>±. m5^m\^xmmLfzXdiz. )i<j:a^t;±3V'>T{±. ^-^s^t* 

[0053] 

tfz. ^mmmizi5\.^x . m3im^^xm,mLfzmfrimi'^xu. sst^v^T. 33^- 
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'^mx'hh. 

[0054] 

116 {i. ^cr>i§^co—mm:^4zi^:Bm7ikmmcD—mi^Lfzmx'f>^. 

^t:^'tmmiz^mmmwmi}-^'f^^^tifz^^~fpmmmmif^}mizi:'yx 1 y 

ii^-rkLxm^^tiX—wm^^m^^Tm^^tL^. mmc^mxn. xy-ii-^mwm 
4 2 a i: 4 2 b i^i^^^x^-ji^^mmmMti^ 1 ^'/v—Tb Lx . X y-)vmm^A 3 
atAShbASc ti)-^i^^£^xy~jv^mmi9mifiyfv~y°t LX. x'r-jv^mm 

X'm7n^fVX\^h . Xdr~)V^mm{^A2a.. 43 a. 44a{±. H4t:^LfcXir 
-;l^MB«2 6. 2 7. 2 8t|5ltT-S)i.. 
[0055] 

ifc, mecn>mwmm><zti\'>xi>, x^y-^fsn^iz^^mi^^^^hzt^zx-iX. 
m^i^-^tix\^^j:\m^)c^)xy-)i-^mmmt:m^^-t^^t:^'^^mx-h^. ttz. »mm 

^t^mx'h^. 

[0056] 

-^mmmi. V-^ x^-l^^yitsK ijy°^)Vmmm.2\,zi.r)%\^^^ixj-^^^(ri 

mwmk(^^-b-h. fh'^tn'mmk^^hwmm^h lx. fmo^^'mmi^^hwrnm. 
^mdi'thi,<^x'^'^ . \mM. mm\hwmz. m&Lfmm'mk\,zi6\^xyv-j^ 
m^ifi'^mthmm%m^mz---^-i-^m{mm:mKL. ^<r>mi.Lfzmmm.-k . m 

[0057] 

mat. ^mmiiz^h. xi^-i^a y7 (7)m^mi¥^^'tyn-^-^-hX'h 

^„ ^i^i,mmmi tmrntz. cpu i st^Romi 4t,z^^fm^tix^-^i,mm 
yaip'^j^.^m^m LUfif -g. -r t i,zi.-^x'iii:>ixhm'^<^—^x'hh. 

mm^zii\,^x. t-r. si ix-n. mmcr,si (msmm) tmmiz. j<=eoi6^^i^ 
wj^coB^commmmzm^mm.mmcoim&?^tmhtih. ^^a-tfoKfi^iFiir^w 
(ciji-^Tt. mmmitmmiz. ;^y°^fi-m\^mm2iz^K)mm^tifz^mcomm.mmti^ 

.mmnz?i^O 1 6iZtm^ixX^^^i>cr)t^i,^ 
[0058] 

m^-^x, s 1 2XU. mXT-'yrxm.^&ttitzmimmco^^-h, m^ofewigsr^r 

m^^i^mm^zi^»>xi6^ . ^<r>3^i^\m^'tAM.t-thfmmm^^z. ^v^ji^co^^ 
hc^>. ^v^im^M^<^mimm^z\^.^m\^,i.c^)i':>ximmcom^wmn(^mmm.(^)'^ 

[0059] 
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m^ixi,—jcomimmi. mmcoss msmm) yu-j^^^-imh'b^ 
^mimmt'ti>i}\ y]y~j^^^-i}^mh:>z^ ^miSLimmt-r^ ^ t h-^mx-hh. 

[0060] 

ii}M<7)S 1 4Jb^S 2 Ocr,^l>z-:>\-iXlt. mi^cTiSATj^S 1 0 (ia3#Hg) comm. 

, s 1 5^m^. s 1 3i,zxmm^tLfzmimmizi^^mim^^iznL-mm^i,zmi:^ 
Tv-^ ih\,z-^m7r^<^m^izi: ^m.^^tL^ ( s 1 6 > , 

[0061] 

rn^Mt. siA\,zio\^x. \!m.^<^^mmm^^^titz^\,z\t^ siy^ii;^^ 

. mwMmitK ^c^^^mmm^i<z)ititfzm\m^m.i<z-^m^'&^Kh. i^. ^mmm 
{.zav^xh. m.'&^tifzmm.mmnzm\:.x . i'^^s.^tihxdr-jvmmmmif.-^^ x 
iot^-^Tv^s. ^Lx. si3\,zxm.i^^fifzmmmmL\,zmhmwt.cn^'^\>z 
ML. s 1 ihzxm^-^nfzmm^mzm^tzx';r~)v^t^'^t>fLxt(hi<m^^L< 
i±m'hm^tKi:^xy~)immmH¥)^^fi (s i s) . ^<omm.m^mzm\:-fzm.<r> 
xir-;\^^mmi'^'r ^ xy'\y-( 7 hi,z}\mk^com^xm^^ix^ ( s 1 9 ) . 

[0062] 

s 1 6X{±s 1 9(Dm±. mmmcom^iizmtx . ^msmzm^ryuy-i^aycom 

'^mrmfj^:b^^iixfz:^-^:^-tim^^fl ( S 2 0 ) . ^comm^m^Yescr)M^lZl^:^ 
«)fW*^T t . N o <r>t§-^t,zlt S 1 4 D ±M(^mS.=S:B K) M^r. 

:$^mmzt5\^x. si exit. mtimmcr)m4{z^Lfz—^^tnmi,z>i.^~ 

[0063] 

jiLh, ^mmmizxtni. :^y'-t)i-m.^^mmi,zx Kimm^tifz^mcommmmcofpt-i^ 

, mikMmmm § tifzmm (^zm s mmmm t l t ^i^m s tifzmimmizi^ h miS'<.<^:>^ i 
it i t :*>-c§ ^ cr>x\ mmmit . :^xcmm'mmi,zm^mm^mm-ri zb^< 
. ^^izm5iK3m'm^^ixtzmm^miMrthzb:^-^x^i>. ttz. ^jfm^-s^Sts 
^tm:i!K.^^w ^mi^^it 5&«-c# -s. cox. mmrnit. ^mizm tx . l^v m 
mcom^nM.^ij]K)mt^^tt^x^i>. ttz. ^cot^izm^-^tchmmt. yv—i. 
^^-^mmrmimmmmiz—^-^-^mtR^tifzmmmm^zmmmz^^^^ t t-^h . 
mmmii. n-w>&.imti:^nm-t:>m^Ltzm^^mfM.hmm-ttb\^-^fz^htm< 

[0064] 

^mmizi^^m7iz7j^Lfzm7j^mmzts\,-^x. mm. si9i,zxnt>tLMm 
m^izm-^xi±. mm<7)m5im^^xmmLfzhc^kmmiz. m^MM^. mstmmm 
m^titzmimzmmimmtLxmiH^titzmmmm^zioux. #s<^. 7^-a#^ 
Tb^mt-t h mmmm {z\% s y. 'r~)i-mm\m'---m o #;c j; ^ (c l t c> ji< . ttz. 
-wm.^i,ziiv^xhnmiz. \!i]i&mmm^^fifzmm\'Z\%hmmmLhL 
xm\i^^fu-zmm'mk\,ziiux. m&cr>. y\y~j^^m}^wm-hmwmmm\,z\^hx^ 

[0065] 

t.fz. immmiz^tmi iz^Ltzmi^mmzax^x . mui. s 1 5xi±. s 1 2-c 
m.d^^fitz±x<^mimmi<zi^hmmznLx. -mM^^^zmttzxy-tv^m^n-yx 
x'r-iv^mmi-^^w^SiL. m< s 1 exu. yu-j^^mmm-ti^mmmmmt^^ii^ 
f^^tLtzxy-iu^mmmi 1 ^')\^-y°t Lxm^Lxx^-)u^mmm<^-wm^^ 
noXoi,z^^^ti>'^mxhi><, :icom^i,t. mtimmcomet^z^^Lfz-mm^bm 
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[0066] 
[0067] 

U^'^J^tK CD-ROM. DVD, 7 D b°- ( SimS) x -T -X^^<7)«rffiiEli«f*: 

^'yj^t)^mimmwi,zim^tLxv^h*^\>z\i^ ^ay^mmmm^v-^ a 

my°^^'yM.t)mAMi 5. j<^ui 6mcr>tmmztm^iixmmy°r>^'^Atimn^ 
tL^. mut. Tn^^juM«#3&»^>a«iiii^ (^-ybv-^i 1^) ^■iYLx^(r>mm 
y'a^^Amm^tii^^izii. y'uf^^Mmmcoimmmm^ii^'^ ^jmzmm^ 
nx\>^mmy°^^'y2>.:^mmmmi:it-LX'^-^' a y7 i,z^iE^tL. Sfistt 

m-rthc^x^y-^xhrn^ 

[0068] 

^izLx\<^^t\ smi,zmtxm(Dwmi^^^mmmm^mtii^^j:oizT^zbh^ 

[0069] 

l*I^Iii2(cj;oTHt^?|J^cffi^t$^^:^cHmwfgi: Lfz'/iK mco&mmw.i,zx^x9^mmz 
mn^titimmmmt Lxi,^< . m^^imcommnzsm^tifzmw^mt Lxi>^\>^ 

[0070] 

liLh, *l|BJoB^^MI, H«^*:^ffi, &immmpjky')j^yM.iz-:)\^xmmi,z 

mmLtztiK :^^m±±timmmizmm^tL-t. :*^wM<7)W^^mm.L^j:^mm^zt3\>^x 

[Wcoffi^^ri^HJ] 

[0071] 

[01] *^B3iO-SI)lMtffiSB««5^K^®fflL:^^;*r-fe;USl*l?ili>'>t.7^A<7)^ 
[02] V-i^X-f-i^ay^vJ^f-A^ffigia-r-S,^, 

[113] MfS0iJlWf.|.. y-^Xx-v-gyco^^f^^S^-r^a-f-v-b-C^S, 
[114] S 6T'7-V XTl^-^ tc^^StiJt— ll^t:«'&^^Bffic?)^MS*L3tllT'3b 

[115] s 9 i^-^ i<zm^^tLfzm<$:m^iz{^hm^mm(7)—m^:ij^tfzmxh 
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[06] — fg^t3'f«§^]ilHt0ffi£0M&*t/tllT-*l>. 
[0072] 
3 yi-y^r-i^' 

4 

5 >^V^^-yh 



I 0 f—^'^—X 

II ^^^^/hV-^f 

12 CF;<^V 

13 CPU 

1 4 ROM 
1 5 RAM 
16 

1 7 I/F 

1 8 a^SgE 

1 9 m^gp 

2 0 A*gE 

2 1 ^N'X 

2 2 -mrn^y 

2 3 Jiii^:;i<^yffiis 

23a Ife^^^'y 

23 b 2?^4^'^'y 

23 c Ai^^n^y 

2 3d HllPW^^^^y 

2 4 mmmw^m 

25. 26. 27. 2 8. 29. 30 MM 

31 X^-f^ 

3 2 isaisw^jjf^s'y 
3 3 iSB^^f'^y 

34 i£rJV4^^':x 

3 5 -^^'^y 

3 6 rJV.H'^'y 

3 7 S^,ii-^'>' 

3 8 ft^Bi^^'^'y 

39 mth^^^y 
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42a. 42b. 43a, 43b, 43c. 44a 
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[07] 
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(51) Int. CI. 7 
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G 0 9 G 5/00 5 5 0 C 
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